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Abstract 



We study functional activity in the human brain using functional 
Magnetic Resonance Imaging and recently developed tools from net- 
work science. The data arise from the performance of a simple be- 
havioural motor learning task. Unsupervised clustering of subjects 
with respect to similarity of network activity measured over three days 
of practice produces significant evidence of 'learning', in the sense that 
subjects typically move between clusters (of subjects whose dynamics 
are similar) as time progresses. However, the high dimensionality and 
time-dependent nature of the data makes it difficult to explain which 
brain regions are driving this distinction. Using network centrality 
measures that respect the arrow of time, we express the data in an 
extremely compact form that characterizes the aggregate activity of 
each brain region in each experiment using a single coefficient, while 
reproducing information about learning that was discovered using the 
full data set. This compact summary allows key brain regions con- 
tributing to centrality to be visualized and interpreted. We thereby 
provide a proof of principle for the use of recently proposed dynamic 
centrality measures on temporal network data in neuroscience. 

1 Motivation 

A network-science perspective can give valuable insights into neuroscience 
data sets [5]. In particular, it is useful for summarizing and comparing net- 
work properties in terms of a few key features [HI El [25], discovering cohesive 
groups of brain regions and other important patterns such as neuron order- 
ings [H|7],[T6], and identifying important (i.e., 'central') brain regions [2?ll3"l]. 

Research on networks in neuroscience has focused primarily on static situ- 
ations (because this allows one to use well-established tools [23]), but current 
functional magnetic resonance imaging (fMRI) experiments offer the oppor- 
tunity to study interactions that vary over time. Such dynamic or temporal 
networks arise in many other applications — including mobile phone commu- 
nication [21], interactions in online social networks [31], criminal activities 
[25] . voting in political bodies, and much more [TB] . 

One way to study temporal networks is to develop time-dependent gen- 
eralizations of classical network 'centrality' measures [321 [23], which are de- 
signed to measure which nodes (or other network structures) are important 
in a network. Different notions of centrality correspond to different contexts 
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for what it means to be important. The aim of the present paper is to test a 
recently proposed temporal centrality measure designed to quantify 'commu- 
nicability' in dynamic networks [13] in the context of functional neuroscience 
and to highlight its potential for extracting useful information from this type 
of high-dimensional data. 

The rest of this paper is organized as follows. In Section [2j we discuss 
the data that we use and what we aim to achieve in our analysis. In Section 
[3j we review 'communicability' in dynamic networks. We present our results 
in Section |4j and we discuss their implications in Section |5j 



2 Data and Aims 

We study brain activity using the noninvasive neuroimaging technique of 
fMRI, which provides a quantitative measurement of regional changes in 
blood flow that are thought to be related to synaptic activity [21]. Our 
goal in this study is to identify meaningful temporal patterns related to 
brain function changing over a time scale of minutes to days. We therefore 
examine fMRI data that was acquired during a simple learning task in which 
20 subjects practiced short sequences of finger movements (12 movements 
per sequence type) over the course of 3 days [TJ [33]. Our data set is therefore 
composed of 60 experimental sessions. 

We construct dynamic functional brain networks by first parcellating the 
brain into 112 anatomically distinct areas, which we represent as network 
nodes. We then partition the mean signal from each of these regions from all 
experimental sessions into 25 time steps of roughly 3 minute duration each 
(corresponding to time series of 80 units in length). Thus, the full experiment 
consists of 25 time steps per subject. To estimate the interactions (i.e., the 
edge weights) between nodes, we need to calculate a measure of statistical 
similarity between regional activity profiles. Using a wavelet transform, we 
extract frequency-specific activity from each time series in the range 0.06- 
0.12 Hz. For each subject s, each experimental day d, each time step t, and 
each pair of regions % and j, we define the weight of an edge connecting re- 
gions % and j as the coherence between the wavelet coefficient time series in 
each region (other measures of similarity are also possible |26j), and these 
weights form the elements of a weighted temporal network A with compo- 
[t. 



nents 



, where s G {1, ■ • • , 20}, d G {1, 2, 3}, and t G {1, ■ ■ ■ , 25}. We 
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used a statistical correction (the false discovery rate) to threshold all connec- 
tions for which we were not confident that the coherence value is significantly 
greater than that expected between random variables, and we then binarized 

the data. Specifically, A^ d = 1 if and only if the fMRI time series from 

regions i and j demonstrates statistically significant temporal coherence for 
subject s on day d at the t th time step of the experiment. We set all other 

to 0, from the measured connections (edges) approximately 9% are 

' -I id 

.sept as statistically significant. We can therefore view each experiment as a 
time-ordered sequence of 25 binary, symmetric adjacency matrices of dimen- 
sion 112 x 112. We also note that each diagonal entry A * d = 0. 

In a previous examination of this data, we used time-dependent commu- 
nity detection (22] to identify statistically significant temporal evolution of 
network organization over time [I]. We found that network 'flexibility', mea- 
sured in terms of the time- varying allegiance of nodes to communities, in one 
experimental session predicted the relative amount of learning demonstrated 
in a future session. Our goal in the present work is to use a complementary 
approach, based on a recently proposed notion of temporal network centrality 
that respects the arrow of time [13J , to examine the data from a different per- 
spective. Methods to study temporal networks are being developed rapidly, 
and they need testbed examples. It is therefore crucial to apply multiple 
viable approaches to the same data and evaluate the different insights and 
perspectives that they offer. Very recent work has examined static centrality 
measures in functional brain networks [19], and our work generalizes such 
perspectives to time-dependent situations. 



3 Dynamic Communicability 

Network centrality measures are designed to measure which nodes (or other 
network structures) are important [32j [23], and many of them can be moti- 
vated by considering how information flows around a network [9]. In such 
a perspective, central nodes are those that can use a network's connectivity 
structure to distribute or collect information effectively. In a time-varying 
network, where connections come and go, it is important to consider routes 
around the network that respect the arrow of time. For example, suppose 
that nodes a and h are connected today via an undirected edge and that 
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nodes b and c are connected tomorrow via an undirected edge. The route 
a i — y b i — ^ c can thus be traversed over the course of the two days. However, 
unless there are other edges, the reverse route from c to a cannot be taken, 
as the arrow of times introduces an asymmetry in the information flow [15J. 

Reference [T3] quantified the ability of a node i to send information to 
node j across a time-dependent network by summing over all dynamic walks 
from i to j. If we make the supposition that walks that traverse more edges 
are less relevant than those that traverse fewer edges, then the contribution 
to the sum from a walk that uses w edges is scaled by a w . The parameter 
a G (0, 1) governs the extent to which we downweight for number of edges. 
This methodology was introduced by Katz [T7] for static, unweighted, undi- 
rected networks (also see the interpretation in [1]). Katz noted that a can 
be interpreted as the independent probability that information successfully 
traverses an edge. Importantly, because we binarize the data, we retain a 
dynamic analog of this interpretation in the networks that we study in the 
present paper. 

The aforementioned pairwise summary, which suggests how effectively 
node % can communicate with node j, is computed readily as the element 
in a product of matrix resolvents: 

V„ := (/ - OAS)" 1 (/ - - . - (j - . (1) 

In practice, we use a normalized version, 

s ' d ' \\v. 4 \\,' 

where || ■ H2 denotes the Euclidean norm, in order to avoid underflow and 
overflow. The matrix inverses in exist as long as a < a*, where a* is the 
reciprocal of the maximum eigenvalue (in modulus) over all of the individual 
adjacency matrices. In this work, we use the value a = 0.9a*. As discussed 
in [13] , averaging the connectivity information over time and computing the 
Katz centrality for this static summary (thereby ignoring the time ordering) 
can produce significantly different results. Accordingly, it is important to 
use a method that respects the time-dependent nature of the problem. 

The matrix entries {[Qs,d] nj }}i 2 i quantify the ability of node n to dissem- 
inate information to each node in a network. One can sum over the elements 
in the n th row to compute an aggregate broadcast strength h(n) for node 
n. Similarly, by summing over the elements in the n th column of [Q s ,d], we 
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(2) 



quantify the ability of node n to receive information using the receive strength 
r(n). This yields the broadcast centrality 

112 

b« d := (Qs, d ) nj ( 3 ) 

3=1 

and receive centrality 

112 

r(n) s4 :=J2(Qs4) m (4) 
i=l 

from [13] . 

In the next section, we demonstrate that (a) the fMRI data provides evi- 
dence of learning, in the sense that subjects typically move between different 
clusters (of subjects based on similar neural activity patterns), based on these 
centrality values, as time progresses; and (b) that (time-respecting) dynamic 
communicability captures the same effect in a low-dimensional summary that 
is amenable to visualisation and interpretation. 

4 Results 

We seek brain signatures reflecting learning-related change as subjects re- 
peat the motor task. We do this by treating each experimental session as 
a data point and performing unsupervised fc-means clustering [10] to sepa- 
rate the experiments into two groups. We then view the clusters in terms of 
their subject/day identifications (IDs) to determine whether the two clusters 
represent different stages of learning. 

In Table [T|a), we show the clustering that we obtain when we represent 
each experiment using its full set of connectivity data — i.e., when we stack 
the matrices {A^ d }j£ 1 column by column into a single vector of dimension 
112 x 112 x 25 = 313,600. We hypothesize that cluster 2 might represent a 
higher level of 'ability' or 'experience' and hence that moving from cluster 1 
to cluster 2 represents the result of learning. To be more concrete, we regard 
the data processing/clustering as a 'success' for subject s if the cluster label 
does not decrease either between days 1 and 2 or between days 2 and 3. In 
other words, a subject is successful if he/she does not exhibit a decrease in 
learning-related changes in brain function. For example, subject number 1 
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a) Full Temporal Data 
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b) Dynamic Communicability Matrix 
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Table 1: Results of unsupervised fc-means clustering into two groups, dis- 
played by subject and by day, using (a) the full temporal data (which has 
dimension 313, 600) and (b) by summarizing each experiment in terms of 
the dynamic communicability matrix ^ (which has dimension 112 x 112 = 
12,544). We also obtain the same results as in panel (b) using a vector of 
either the broadcast centralities ^ or receive centralities Q. Each of these 
descriptions has a dimension of only 112. 



in Table [T](a) has the sequence 1, 1, 2 and subject number 3 has the sequence 
1,2,2, so both s = 1 and s = 3 are successful. Subject number 9, who has 
the sequence 2, 2, 2, is also successful. However, subject 5 has the sequence 
1,2,1 and is therefore not successful. In total, the 20 subjects include 17 
successes and 3 failures (subjects 5, 8, and 20). Using a permutation test, 
where we redistribute cluster labels A and B uniformly at random across 
experiments and map the labels A and B to the labels 1 and 2 in a way that 
minimizes the number of failures, we find that the achievement of 17 or more 
successes has a p-value of p ~ 0.0025. For this example (as well as all of 
our other fc-means computations), we note that multiple runs with different 
starting values yield very similar results. 

In Table []Jb), we show the corresponding results that we obtain when 
we summarize each experiment (of 25 time points) using its dynamic com- 
municability matrix (|2]), which we stack column by column into a vector of 
dimension 112 x 112 = 12,544. We again observe 17 successful subjects and 
3 failures (subjects 5, 11, and 17). 

We also apply the same clustering approach with each experiment col- 
lapsed to a vector of either broadcast ^ or receive Q centralities, where we 
recall that each component of either vector represents a single brain region. 
Using either of these vectors, which have a dimension of only 112, we find 
identical results as with the 12, 544-dimensional description. 
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The aforementioned results suggest (i) that there is evidence that the 
fMRI data has captured a learning effect, and (ii) that the evidence remains 
intact even when we vastly reduce the dimension of the data by using only 
broadcast or receive centrality measures, which have a natural interpretation 
in terms of quantifying the ability of a brain region to distribute or collect 
information. 

Because the broadcast and receive centralities relate directly to individual 
brain regions, we follow up on the results in Table [T] and study how these 
centralities vary over time. We find that broadcast and receive centralities 
both decrease appreciably over the 3 days of the experiment, suggesting their 
potential sensitivity to learning (see Fig. In addition to their temporal 
dependence, these two types of centrality vary over individuals in the experi- 
ment (see the error bars in Fig. [T}\) and over brain regions (see Fig. [l]^.). We 
also find that broadcast and receive centralities are strongly correlated with 
one another over brain regions for all 3 days of the experiment (see Fig. [IB). 




From the above results, it is unclear whether the broadcast and receive 
centralities for each brain region decrease similarly over days or whether 
the values for some brain regions decrease more than those for others. We 
therefore test whether any brain region has a change in its centrality values 
between day 1 and day 3 that is more than what is expected given the aggre- 
gate decrease shown in Fig. [TJ\. To do this, we normalize the broadcast and 
receive centrality vectors from the 60 communicability matrices separately. 
For each region, we then test whether the normalized centrality values dif- 
fer significantly in day 1 versus day 3 using a permutation test in which we 
permuted the day 1 and day 3 labels uniformly at random. We find that no 
brain region demonstrates a significant decrease in either normalized broad- 
cast centrality or normalized receive centrality from day 1 to day 3 (p > 0.01; 
uncorrected for multiple comparisons). 

In light of the result that brain regions do not differ significantly in the 
amount of centrality change with learning, one can study the anatomical 
distribution of centrality values by normalizing each experiment's central- 
ity values, aggregating the normalized regional components from all the 60 
experiments, and then viewing the aggregate over regions (see Fig. [2]). We 
find that dynamic centrality values are greatest in bilateral precentral gyri 
(primary motor cortex), medial segment of the superior frontal gyrus (supple- 
mentary motor area), superior parietal lobule, and medial occipital cortices. 
This constellation of regions is a core sensorimotor system for controlling a 
broad range of visually guided actions |2J. Of particular note, two of these 
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Day1 Day 2 Day 3 0.2 0.1 0.2 0.1 

Broadcast Centrality 



Figure 1: Broadcast and Receive Centralities Change with Task Learning. 
(A) Bar graph showing broadcast (light) and receive (dark) centralities aver- 
aged over brain regions for day 1, day 2, and day 3 of the experiment. Error 
bars indicate standard deviations of the mean over subjects. (B) Scatterplots 
showing the Pearson correlations between broadcast and receive centralities 
for day 1 (correlation coefficient r « 0.86; p-value p ~ 2.4 x 10~ 35 ), day 2 
(r rj 0.71; p « 6.6 x 10~ 19 ), and day 3 (r « 0.60; p « 1.8 x 10~ 12 ) of the 
experiment. 



areas — the primary motor cortex and SMA — are consistently observed to 
demonstrate changes of local activity f[5].[T2].[H]) as well as changes of cor- 
related activity during sequence learning [30] . 

5 Discussion 

Broadcast and receive centralities are typically examined in the context of 
fast time scales, yet the 3-minute time scale in the experiments is a long time 
scale. The striking decrease in broadcast and receive centrality values over 
the course of the experiment is consistent with theoretical work indicating an 
increase in neural efficiency with learning [TT]. In this view, greater skill at 
applying an initial task-related strategy leads to a temporal increase in the 
efficiency of neural processing, which can manifest as an aggregate decrease 
in measurements of brain function [20J. 

It has been suggested that an understanding of such changes and their 
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| | 0.6 1 1 0.1 
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Figure 2: Anatomical Distribution of Broadcast and Receive Centralities. 
Broadcast (A) and receive (B) centralities with normalized centrality vectors 
over subjects. 



relationship to neural efficiency will require a more careful examination of 
functional connectivity patterns |18j . which are thought to be better indi- 
cations of neuronal communication than activity patterns alone [29]. The 
present paper highlights the potentially important effect of temporal dy- 
namics in the consideration of neural efficiency, and recent methodological 
advances for the investigation of time-dependent networks [TS] now make it 
possible to pursue such efforts. We demonstrate decreases in functional con- 
nectivity patterns with task practice in early motor learning, suggesting that 
the brain might require less communication between distributed functional 
networks as skills become more automatic. 

The ideas that we have employed in this study have important potential 
applications not only in the setting of fMRI experiments but also in the 
examination of functional neuroscience data using other experimental modes. 
Interest in studying whole-brain functional connectivity patterns in a network 
framework is growing steadily (5] , in part because network science includes a 
large set of diagnostics that are built to directly examine system connectivity 
and can be used to characterize the brain's structural organization. However, 
a study of the true dynamic nature of the brain requires the use of dynamic 
network diagnostics, the development of which is still in its early stages [15] . 
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We have demonstrated in this paper that broadcast and receive centralities 
are useful diagnostics for the study of temporal brain networks, and they 
have the additional advantage of respecting the arrow of time. We expect 
such dynamic centrality measures to be similarly insightful in a wide variety 
of systems. 
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